Virtual reality dining

ABSTRACT

A method, system and computer program product for virtual reality dining includes establishing an index of different human consumables positioned on a sensory surface of a serving tray and, generating in a display of a virtual reality headset, a rendering both of a thematic visual background and also a display of different graphical representations of corresponding ones of the different human consumables at different positions consistent with the index. Thereafter, the removal from the serving tray of one of the different human consumables is detected. In response, a theme of the thematic visual background changes and the thematic visual background re-renders in the headset with the changed theme. Finally, the method includes animating the movement of a display of a corresponding one of the different graphical representations of the removed one of the different human consumables in the headset.

BACKGROUND OF THE INVENTION Field of the Invention

The present invention relates to the field of virtual reality and moreparticularly to a virtual reality dining experience.

Description of the Related Art

Virtual reality refers to the computerized display of acomputer-generated environment imitating a corresponding real-worldphysical environment. In virtual reality, the computer-generatedenvironment often provides a first-person viewpoint and is responsive tocomputer directed movements so that the first-person viewpoint presentedin the computerized display changes according to the computer directedmovements. Early forms of virtual reality required the end user to inputthe computer directed movements through a conventional computing system.But, more recent virtual reality systems incorporate human wearable orholdable sensors so that the movements are translated directly from thesensed movements of the human wearable or holdable sensors. Indeed, themost recent renditions of virtual reality rigs include a wearableheadset such that the end user only perceives the imagery on a displayof the headset without seeing any of the real, physical world. In thisway, virtual reality has become an immersive experience.

Virtualized object manipulation is the cornerstone of much of the modernvirtual reality experience. For example, it is well-known to present avirtual reality environment in which the end user is instructed toretrieve virtual objects in a virtual room displayed in a headsetdisplay worn by the end user as the end user holds or wears movementsensors. As the movement of the hands of the end user are detected tocorrespond to a virtual proximity of one of the virtual objects, thevirtual reality environment generates a display in the headset showingthe virtualized hands of the end user holding the one of the virtualobjects. Thus, the virtual reality environment presented in the displayof the headset of the end user intends upon mimicking as best aspossible the corresponding real, physical world. In doing so, however,little opportunity remains for creativity in deviating from a propervirtual representation of the physical world because the intent is tonot deviate but to conform the virtual representation to that of thephysical world.

BRIEF SUMMARY OF THE INVENTION

Embodiments of the present invention address deficiencies of the art inrespect to the conventional virtual reality experience and provide anovel and non-obvious method, system and computer program product forvirtual reality dining. In an embodiment of the invention, a virtualreality dining method includes establishing an index of different humanconsumables positioned on a sensory surface of a serving tray and,generating in a display of a virtual reality headset, a rendering bothof a thematic visual background and also a display of differentgraphical representations of corresponding ones of the different humanconsumables at different positions consistent with the index.Thereafter, the removal from the serving tray of one of the differenthuman consumables is detected. In response, a theme of the thematicvisual background changes and the thematic visual background re-rendersin the headset with the changed theme. Finally, the method includesanimating the movement of a display of a corresponding one of thedifferent graphical representations of the removed one of the differenthuman consumables in the headset.

In one aspect of the embodiment, a hand is rendered in the display ofthe headset imagery in connection with the animated movement of thedisplay of the corresponding one of the different graphicalrepresentations of the removed one of the different human consumables.In another aspect of the embodiment, a physical movement of the removedone of the different human consumables may be tracked, the animationperformed in the display of the headset in correspondence to the trackedphysical movement. For instance, the tracking may be performed with asensor affixed to the removed one of the different human consumables, orthe tracking may be performed with a sensor affixed to a wearableholding the removed one of the different human consumables. Finally, ineven yet another aspect of the embodiment, the corresponding one of thedifferent graphical representations is different in appearance than anactual appearance of the removed one of the different human consumables.

In another embodiment of the invention, a virtual reality dining dataprocessing system is provided. The system includes a serving tray thathas a sensory surface. The system also includes a headset. The systemyet further includes a host computing system disposed in the headset, incommunication with the sensory surface of the serving tray, and thatincludes at least one processor, memory and a display. Finally, thesystem includes a virtual reality dining module. The module includescomputer program instructions executing in the memory of the hostcomputing system. The computer program instructions perform theestablishment of an index of different human consumables positioned onthe sensory surface of the serving tray and the generation in thedisplay, of a rendering both of a thematic visual background and also adisplay of different graphical representations of corresponding ones ofthe different human consumables at different positions. Finally, inresponse to detecting removal of one of the different human consumablesfrom the serving tray, the program instructions perform the changing ofa theme of the thematic visual background, the re-rendering of thethematic visual background in the display with the changed theme and theanimation of the movement of a display of a corresponding one of thedifferent graphical representations of the removed one of the differenthuman consumables in the display.

Additional aspects of the invention will be set forth in part in thedescription which follows, and in part will be obvious from thedescription, or may be learned by practice of the invention. The aspectsof the invention will be realized and attained by means of the elementsand combinations particularly pointed out in the appended claims. It isto be understood that both the foregoing general description and thefollowing detailed description are exemplary and explanatory only andare not restrictive of the invention, as claimed.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute partof this specification, illustrate embodiments of the invention andtogether with the description, serve to explain the principles of theinvention. The embodiments illustrated herein are presently preferred,it being understood, however, that the invention is not limited to theprecise arrangements and instrumentalities shown, wherein:

FIG. 1 is a pictorial illustration of a process for virtual realitydining;

FIG. 2 is a schematic illustration of a data processing system adaptedfor virtual reality dining; and,

FIG. 3 is a flow chart illustrating a process for virtual dining.

DETAILED DESCRIPTION OF THE INVENTION

Embodiments of the invention provide for virtual reality dining. Inaccordance with an embodiment of the present invention, different humanconsumables—namely food or drink—are placed at different positions on aserving tray configured with a sensory surface. An index is thengenerated in connection with a placement of the human consumables at thedifferent positions and a graphical representation of each of theconsumables is displayed in a display of a virtual reality headsetconsistent with the index. As well, a thematic visual background isdisplayed in the display of the virtual reality headset, such as avisual background of particular pattern or color arrangement.Thereafter, upon receiving a signal from the serving tray in respect tothe detected removal of one of the consumables, the theme of the visualbackground changes to a different theme. Additionally, a graphicalrepresentation of the removed one of the consumables is animated inmovement in the display of the headset. In this way, a virtual realitydining experience which deviates from the reality of the physical worldmay be generated for the end user while the end user consumes theconsumable.

In further illustration, FIG. 1 pictorially shows a process for virtualreality dining. As shown in FIG. 1, a serving tray 100 includingdifferent presence sensors 120 on a substrate 100A for correspondinglydifferent sensor pads 110 defining a sensory surface 100B of the servingtray 100. Each one of the presence sensors 120 detects a presence of acorresponding one of the sensor pads 110, for instance by reflectinglight from a light source off a bottom portion of a corresponding one ofthe sensor pads 110, so that removal of the corresponding one of thesensor pads 110 from the serving tray 100 results in the detection bythe one of the presence sensors 120 of the removal of the correspondingone of the sensor pads 110. Finally, a human consumable 130 is placedupon each of the different sensor pads 110, for instance a food orbeverage item.

The serving tray 100 is communicatively coupled to a virtual realityheadset 150A able to be worn by an end user 150. Through thecommunicative coupling, the virtual reality headset 150A receives anitem index 175 specifying a catalog of different ones of the sensor pads110 placed upon the sensory surface 100B and a relative location of eachof the sensor pads 110 upon the sensory surface 100B. As well, uponremoval of any one of the sensor pads 110 from the sensory surface 100B,the serving tray transmits an item removal event message 165 to thevirtual reality headset 150A, indicating which of the sensor pads 110indexed within the item index 175 has been removed from the serving tray100.

The virtual reality headset 150A, upon receiving the item index 175,generates a display 170 of a virtualized form 185 of the serving tray100 for viewing by the end user 150. As well, a graphical representation190 of each consumable 130 is presented in the display 170, recognizingthat the graphical representation 190 may significantly differ inappearance from the appearance of the consumable 130. In this way, theend user 150 viewing the virtualized form 185 of the serving tray 100 inthe display 170 may be led to believe that the consumable 130 is of onetype of food or drink consistent with the graphical representation 190depicting the consumable 130, when in fact the consumable is of adifferent type of food or drink. Importantly, a thematic background 195Ais presented in the display 170 so as to enhance the virtual realityexperience of the end user 150. The thematic background 195A may includea specific color scheme either static or animated, a specific pattern ofcolors, a specific image or set of images, and also may be supplementedwith audio tones or music.

In operation, the end user 150 may remove one of the sensor pads 110with an associated one of the consumables 130 placed thereon. Theremoval of the one of the sensor pads 110 is then detected by acorresponding one of the presence sensors 120 and reported by theserving tray 110 to the virtual reality headset 150A in an item removalevent message 165. Additionally, the spatial movement of the removed oneof the sensor pads 110 is tracked through the sensing of a tracking tag140 disposed upon the removed one of the sensor pads 110 by apositioning tracking system 145 affixed to a front face of the virtualreality headset 150A. Optionally, in lieu of the tracking tag 140 havingbeen disposed upon the sensor pads 110, a tracking tag 140A may bedisposed instead on a wearable 180 such as a glove, ring or wrist bandworn by the end user 150.

Owing to the tracking of the tracking tag 140 (or tracking tag 140A), bythe position tracking system 145, position data 155 is provided to thevirtual reality headset 150A. Responsive to the receipt of the positiondata 155, coupled with an identity of the removed one of the sensor pads110 in the item index 175, the virtual reality headset 150A animates inthe display 150, a corresponding one of the graphical representations190 for the removed one of the sensor pads 110 along with a graphicalimage of a hand 160 so as to show the virtualized movement of theconsumable 130 disposed upon the removed one of the sensor pads 110. Aswell, the existing thematic background 195A may be changed to a newthematic background 195B in correspondence to the identity of theparticular consumable disposed upon the removed one of the sensor pads110. In this way, a fanciful, virtual reality dining experience may bepresented to the end user 150.

The process described in connection with FIG. 1 may be implementedwithin a computer data processing system. In further illustration, FIG.2 schematically shows a data processing system adapted for virtualreality dining. The system includes a virtual reality headset includinga processor 210, memory 220 and a display 230 and is coupled to fixedstorage 240. A communications adapter 260A also is provided that isenabled to transmit data to and receive data from other communicationsadapters 260B, 260C. An operating system 250 executes in the memory 220by the processor 210 and supports the operation of a virtual realitydining module 300.

The reality dining module 300 includes program instructions that whenexecuting through the operating system 250 by the processor 210 in thememory 220 are enabled to receive a notification by way ofcommunications adapter 260B from serving tray 270 of an index of sensorpads positioned on the sensory surface 280 and in response, the programinstructions are enabled to store the index in the memory 220 and torender in the display, a virtualized representation of the serving tray270 according to the index and to apply a particular thematic visualbackground stored in the data store 240 in the display. The programinstructions also are enabled to receive by way of the communicationsadapter 260B, a notification that one of the sensor pads 200 has beenremoved from the sensory surface 280, in response to which the programinstructions are enabled to select a different thematic visualbackground from the data store 240 and to render in the display 230 thevirtualized serving tray 270 (absent a graphical representation of aconsumable placed upon the removed sensor pad 200) with the differentvisual thematic background.

The program instructions even yet further are enabled during executionto receive by way of communications adapter 290C from a position monitor290, a relative position of the removed sensory pad 200 and to translatethe relative position to a position in the display 230 so as to be ableto animate in the display 230, movement of a graphical representation ofthe consumable placed upon the removed sensor pad 200. In this regard,the position monitor 290 may be a receiver receiving an infrared signaleither reflected by an array of markers affixed to the removed one ofthe sensor pads 200, or emitted by a transmitter affixed to the removedone of the sensor pads 200. Upon receiving the infrared signal atdifferent infrared sensors set at fixed positions in the receiver, theposition monitor 290 is able to triangulate a position of the removedone of the sensor pads 200 based upon the compared characteristics ofthe received infrared signal at each of the sensors.

In yet further illustration of the operation of the virtual realitydining module 300, FIG. 3 is a flow chart illustrating a process forvirtual dining. Beginning in block 310, the virtualized graphicalrepresentation of the serving tray is initialized as a data structure inmemory and in block 320 an index of consumables placed upon the servingtray built to reflect a relative position of each of the consumables onthe serving tray. In block 330, an initial visual background theme isselected for the serving tray and in block 340 a graphicalrepresentation is selected for each consumable placed upon a sensor padin the serving tray and represented in the index. Thereafter, in block350, a display is generated for rendering in the virtual reality headsetincluding the initial thematic visual background and graphicalrepresentation of the serving tray with an icon for each of theconsumables.

In decision block 360, it is determined if any of the sensor pads on thesensory surface of the serving tray has been removed. If not, indecision block 400 if the process is not yet terminated, the method mayloop back to decision block 360, or the process may end in block 410.Otherwise, in block 370, an identifier for the consumable placed uponthe removed sensor pad is retrieved and located in the index. In block380, a new visual background theme is selected based upon the identifierand a new thematic visual background rendered in the display. As well,in block 390, a position of the removed sensor pad is received fromposition monitoring system with which an animation of the icon generatedfor the consumable is performed in the display by simulating themovement of the consumable from the graphical representation of theserving tray towards a position in the display correspondent to anactual position of the removed sensor pad as indicated by thepositioning monitoring system. Thereafter, the process can repeat for anext removed one of the sensor pads.

The present invention may be embodied within a system, a method, acomputer program product or any combination thereof. The computerprogram product may include a computer readable storage medium or mediahaving computer readable program instructions thereon for causing aprocessor to carry out aspects of the present invention. The computerreadable storage medium can be a tangible device that can retain andstore instructions for use by an instruction execution device. Thecomputer readable storage medium may be, for example, but is not limitedto, an electronic storage device, a magnetic storage device, an opticalstorage device, an electromagnetic storage device, a semiconductorstorage device, or any suitable combination of the foregoing.

Computer readable program instructions described herein can bedownloaded to respective computing/processing devices from a computerreadable storage medium or to an external computer or external storagedevice via a network. The computer readable program instructions mayexecute entirely on the user's computer, partly on the user's computer,as a stand-alone software package, partly on the user's computer andpartly on a remote computer or entirely on the remote computer orserver. Aspects of the present invention are described herein withreference to flowchart illustrations and/or block diagrams of methods,apparatus (systems), and computer program products according toembodiments of the invention. It will be understood that each block ofthe flowchart illustrations and/or block diagrams, and combinations ofblocks in the flowchart illustrations and/or block diagrams, can beimplemented by computer readable program instructions.

These computer readable program instructions may be provided to aprocessor of a general purpose computer, special purpose computer, orother programmable data processing apparatus to produce a machine, suchthat the instructions, which execute via the processor of the computeror other programmable data processing apparatus, create means forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks. These computer readable program instructionsmay also be stored in a computer readable storage medium that can directa computer, a programmable data processing apparatus, and/or otherdevices to function in a particular manner, such that the computerreadable storage medium having instructions stored therein includes anarticle of manufacture including instructions which implement aspects ofthe function/act specified in the flowchart and/or block diagram blockor blocks.

The computer readable program instructions may also be loaded onto acomputer, other programmable data processing apparatus, or other deviceto cause a series of operational steps to be performed on the computer,other programmable apparatus or other device to produce a computerimplemented process, such that the instructions which execute on thecomputer, other programmable apparatus, or other device implement thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof instructions, which includes one or more executable instructions forimplementing the specified logical function(s). In some alternativeimplementations, the functions noted in the block may occur out of theorder noted in the figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems that perform the specifiedfunctions or acts or carry out combinations of special purpose hardwareand computer instructions.

Finally, the terminology used herein is for the purpose of describingparticular embodiments only and is not intended to be limiting of theinvention. As used herein, the singular forms “a”, “an” and “the” areintended to include the plural forms as well, unless the context clearlyindicates otherwise. It will be further understood that the terms“includes” and/or “including,” when used in this specification, specifythe presence of stated features, integers, steps, operations, elements,and/or components, but do not preclude the presence or addition of oneor more other features, integers, steps, operations, elements,components, and/or groups thereof.

The corresponding structures, materials, acts, and equivalents of allmeans or step plus function elements in the claims below are intended toinclude any structure, material, or act for performing the function incombination with other claimed elements as specifically claimed. Thedescription of the present invention has been presented for purposes ofillustration and description, but is not intended to be exhaustive orlimited to the invention in the form disclosed. Many modifications andvariations will be apparent to those of ordinary skill in the artwithout departing from the scope and spirit of the invention. Theembodiment was chosen and described in order to best explain theprinciples of the invention and the practical application, and to enableothers of ordinary skill in the art to understand the invention forvarious embodiments with various modifications as are suited to theparticular use contemplated.

Having thus described the invention of the present application in detailand by reference to embodiments thereof, it will be apparent thatmodifications and variations are possible without departing from thescope of the invention defined in the appended claims as follows:

We claim:
 1. A virtual reality dining method comprising: establishing anindex of different human consumables positioned on a sensory surface ofa serving tray; generating in a display of a virtual reality headset, arendering both of a thematic visual background and also a display ofdifferent graphical representations of corresponding ones of thedifferent human consumables at different positions in connection withthe index; and, responsive to detecting removal of one of the differenthuman consumables from the serving tray, changing a theme of thethematic visual background, re-rendering the thematic visual backgroundin the display of the headset with the changed theme and animatingmovement of a display of a corresponding one of the different graphicalrepresentations of the removed one of the different human consumables inthe display of the headset.
 2. The method of claim 1, furthercomprising, rendering in the headset imagery of a hand in connectionwith the animated movement of the display of the corresponding one ofthe different graphical representations of the removed one of thedifferent human consumables.
 3. The method of claim 1 furthercomprising: tracking a physical movement of the removed one of thedifferent human consumables; and, performing the animating in thedisplay of the headset in correspondence to the tracked physicalmovement.
 4. The method of claim 3, wherein the tracking is performedwith a sensor affixed to the removed one of the different humanconsumables.
 5. The method of claim 3, wherein the tracking is performedwith a sensor affixed to a wearable holding the removed one of thedifferent human consumables.
 6. The method of claim 1, wherein thecorresponding one of the different graphical representations isdifferent in appearance than an actual appearance of the removed one ofthe different human consumables.
 7. A virtual reality dining dataprocessing system, comprising: a serving tray comprising a sensorysurface; a headset; a host computing system disposed in the headset, incommunication with the sensory surface of the serving tray, andcomprising at least one processor, memory and a display; and, a virtualreality dining module comprising computer program instructions executingin the memory of the host computing system, the computer programinstructions performing: establishing an index of different humanconsumables positioned on the sensory surface of the serving tray;generating in the display, a rendering both of a thematic visualbackground and also a display of different graphical representations ofcorresponding ones of the different human consumables at differentpositions in connection with the index; and, responsive to detectingremoval of one of the different human consumables from the serving tray,changing a theme of the thematic visual background, re-rendering thethematic visual background in the display with the changed theme andanimating movement of a display of a corresponding one of the differentgraphical representations of the removed one of the different humanconsumables in the display.
 8. The system of claim 7, wherein theprogram instructions further perform rendering in the display imagery ofa hand in connection with the animated movement of the display of thecorresponding one of the different graphical representations of theremoved one of the different human consumables.
 9. The system of claim7, wherein the program instructions further perform: tracking a physicalmovement of the removed one of the different human consumables; and,performing the animating in the display in correspondence to the trackedphysical movement.
 10. The system of claim 9, wherein the tracking isperformed with a sensor affixed to the removed one of the differenthuman consumables.
 11. The system of claim 9, wherein the tracking isperformed with a sensor affixed to a wearable holding the removed one ofthe different human consumables.
 12. The system of claim 7, wherein thecorresponding one of the different graphical representations isdifferent in appearance than an actual appearance of the removed one ofthe different human consumables.
 13. A computer program product forvirtual reality dining, the computer program product including anon-transitory computer readable storage medium having programinstructions embodied therewith, the program instructions executable bya device to cause the device to perform a method including: establishingan index of different human consumables positioned on a sensory surfaceof a serving tray; generating in a display of a virtual reality headset,a rendering both of a thematic visual background and also a display ofdifferent graphical representations of corresponding ones of thedifferent human consumables at different positions in connection withthe index; and, responsive to detecting removal of one of the differenthuman consumables from the serving tray, changing a theme of thethematic visual background, re-rendering the thematic visual backgroundin the display of the headset with the changed theme and animatingmovement of a display of a corresponding one of the different graphicalrepresentations of the removed one of the different human consumables inthe display of the headset.
 14. The computer program product of claim13, wherein the method further comprises, rendering in the display ofthe headset imagery of a hand in connection with the animated movementof the display of the corresponding one of the different graphicalrepresentations of the removed one of the different human consumables.15. The computer program product of claim 13, wherein the method furthercomprises: tracking a physical movement of the removed one of thedifferent human consumables; and, performing the animating in theheadset in correspondence to the tracked physical movement.
 16. Thecomputer program product of claim 15, wherein the tracking is performedwith a sensor affixed to the removed one of the different humanconsumables.
 17. The computer program product of claim 15, wherein thetracking is performed with a sensor affixed to a wearable holding theremoved one of the different human consumables.
 18. The computer programproduct of claim 13, wherein the corresponding one of the differentgraphical representations is different in appearance than an actualappearance of the removed one of the different human consumables.